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The paper deals with the question of the practicability and the effectiveness of different 
approaches to foster students’ mathematical modelling competencies. Within the 
modelling project ERMO (Acquirement of modelling competencies) a holistic and an 
atomistic approach of mathematical modelling were compared in order to find out 
which approach is more effective in fostering the students’ modelling competencies. 
The results of modelling tests with three measurement points show that both 
approaches foster students’ modelling competencies, but both approaches have 
strengths and weaknesses. The data indicates that the holistic approach is more 
effectively for students with weaker performance in mathematics. 


INTRODUCTION 


For several years, there was an intense national and international didactic discussion 
and research in mathematical modelling (see Blum et al., 2007; Kaiser et al., 2011; 
Stillman et al., 2013). Furthermore, the development of students’ mathematical 
modelling competencies is a central goal of German mathematics lessons, since the 
competency of mathematical modelling has been described as one of the central 
competencies in German educational standards in mathematics. Projects to foster 
students’ mathematical modelling competencies can each be assigned to one of two 
approaches: either a holistic or an atomistic approach (Blomhgj & Jensen, 2003). The 
main goal of the presented study is a comparison of the effectiveness of these two 
approaches in terms of the development of modelling competencies of students. 


In the first part of the paper the theoretical framework will be documented. Then, the 
design of the modelling project will be presented as well as the methods of data 
collection and evaluation. Finally, selected results of the study will be described. 


THEORETICAL FRAMEWORK 


In recent years, mathematical modelling was an internationally highly discussed topic 
of didactics of mathematics. From the discussion resulted various perspectives of 
mathematical modelling that include different representation of the modelling process 
as a cycle as well as goals and modelling competencies. An overview is given for 
instance in Kaiser and Sriraman (2006). 


However, the various definitions have in common that mathematical modelling is 
described as a process of solving real world problems by using mathematical methods 
(Niss, Blum, & Galbraith, 2007). In addition, an ideal-typical process of mathematical 
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modelling is usually illustrated in the form of a cycle (Kaiser, Blomhgj, & Sriraman 
2006), while in reality such processes are characterized by frequent switching between 
the various stages of modelling cycles (Borromeo Ferri, 2011; Martinez & Brizuela, 
2009). Corresponding to the different perspectives of mathematical modelling there 
are various modelling cycles, which are either more useful for application in 
mathematics lessons or in science (Borromeo Ferri, & Kaiser, 2008). The project 
ERM0O refers to a didactical modelling cycle developed amongst others by Kaiser and 
Stender (2013; see Figure 1). 
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Figure 1: Modelling cycle (Kaiser & Stender, 2013) 


The specific definition of modelling competencies depends on the particular 
underlying concept of mathematical modelling (Zottl, Ufer, & Reiss, 2010). Widely 
accepted is that modelling competencies include abilities and a willingness to solve 
real-world problems by using mathematical modelling (MaaB, 2006; Blomhoj & 
Jensen, 2003). The concept of mathematical modelling competencies contains 
different components, namely sub-competencies of mathematical modelling, 
metacognitive modelling competencies, competencies of structuring given problems 
appropriately and goal-oriented, competencies of argumentation and documentation 
and competencies of realising the possibilities of mathematics as well as positively 
valuing these (see for example Maah, 2006). 


The sub-competencies are based on the underlying modelling cycle and include the 
abilities needed to perform the different steps of the cycle. Based on the modelling 
cycle from Kaiser and Stender (2013) different sub-competencies of mathematical 
modelling are distinguishable which can be assigned to three sub-processes of 
mathematical modelling (referring to Zottl, Ufer, & Reiss, 2010): 


e §=©Simplifving / Mathematising (including all competencies needed for the 
transition between real world and mathematics) 
Working mathematically within the mathematical model 

e Interpreting / Validating (including all competencies needed for the transition 
between mathematics and real world) 


The sub-competencies of mathematical modelling are seen a necessary part of the 
modelling competencies, as they enable the modeller to perform the different steps of 
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the modelling process adequately. However, the presence of the sub-competencies 
does not automatically include the existence of the overall modelling competence 
(Zottl, Ufer, & Reiss, 2010). According to Maa (2006) or Stillman (2011) the 
metacognitive competencies play a significant role for the modelling competencies. A 
non-existent or low meta-knowledge about the modelling process as a result may lead 
to considerable problems while working on modelling tasks, for example at the 
transitions between the different phases of the modelling process. 


According to the survey by Blomhgj and Jensen (2003) projects to foster mathematical 
modelling competencies can mainly be assigned either to a holistic or an atomistic 
approach. The holistic approach is based on the assumption that the fostering of 
modelling competencies will be the most effectively by tackling whole modelling 
tasks. The complexity and difficulty of the modelling tasks should correspond to the 
competencies of the students. The atomistic approach is based on the assumption that 
particularly at the beginning of the work with modelling problems the tackling of 
whole modelling tasks would be too time-consuming and not be effectively referring to 
the fostering of sub-competencies of mathematical modelling. Propagated is separated 
fostering of the sub-competencies by tackling only sub-processes of a whole modelling 
process (Blomhgj & Jensen, 2003). 


DESIGN OF THE STUDY 


The central goal of the project ERMO (Erwerb von Modellierungskompetenzen: 
Acquirement of modelling competencies)' was to foster the students’ modelling 
competencies. Furthermore, the design of the single modelling activities was oriented 
towards the promotion of the students’ ability to reflect about their own working 
processes and results. 


The modelling project was carried out in 2012 in Hamburg (Germany) and started with 
a teacher training course conducted in cooperation with Dr. Katrin Vorhdlter in 
February 2012. The participating classes integrated six 90 minutes modelling 
activities, including the tackling of different authentic modelling problems in 
co-operative, self-directed learning environments, as well as a modelling test in a pre-, 
post- and follow-up-design into their mathematics lessons (for an overview see Figure 
2). The classes were divided into two groups: The modelling activities of group A were 
assigned to the holistic approach, while the modelling activities of group B were 
assigned to the atomistic approach. The students of the holistic group dealt with 
complete modelling tasks with an increasing complexity, the students of the atomistic 
group dealt with sub-processes of mathematical modelling separately, especially the 
transitions real world — mathematics and mathematics — real word. The tasks of the 
atomistic group contained active parts, i.e. tasks that require for example to develop 
own real and mathematical models, as well as passive parts, i.e. given models or 


' The project benefited from experiences of the Hamburg working group on mathematics education 
with carrying out and evaluating modelling projects (see for example Kaiser, 2007). 
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solution that were to assess and validate. As hypothesis it was formulated _ that 
modelling activities of the holistic approach is more effectively concerning the 
fostering of the overall modelling competency while the atomistic approach might be 
more effectively regarding the sub-processes of mathematical modelling (Simplifying / 
Mathematising, Working mathematically and Interpreting / Validating). 
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(According to a holistic 
or an atomistic approach) 


Post- 
test 


Teacher 
training 


Modelling Follow- 
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Students: 
Learning questionnaires 
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Figure 2: Design of the study 


Altogether, N=377 students from 15 classes of 9" grade of four secondary higher-track 
schools and two comprehensive schools took part in the project, while only 204 
students of 13 classes participated in all three measurement points (MP), 132 students 
of the holistic group and 72 students of the atomistic group (see Table 1). The 
presented results are based on this panel. 


MP 1 MP 2 MP 3 Panel 
Holistic approach 168 164 169 132 
Atomistic approach 159 132 7 d2 
Total 327 316 266 204 


Table 1: Sample — number of participating students 


The modelling test was designed in a pre-, post- and follow-up-design and conducted 
to evaluate the students’ progress of their modelling competencies. The design of the 
modelling test refers to work by Haines, Crouch and Davis (2001) and Zottl, Ufer and 
Reiss (2011) and others, who developed items that tested different sub-dimensions of 
the modelling competencies. Because of this structure, it is possible to measure 
different dimensions of students’ modelling competency independently from potential 
weaknesses in single phases of the modelling process. The developed modelling test 
covered the three sub-processes of mathematical modelling (Simplifying / 
Mathematising, Working mathematically and Interpreting / Validating) as well as an 
overall modelling competency including the competence of carrying out a whole 
modelling process and matching different parts of a solution of a modelling task to the 
right phases of the modelling cycle. Per measurement point, the number of used items 
per dimension of the modelling competency varied between 15 and 24. 


The data were scaled by using methods of multidimensional item response theory and 
with an approach of so-called virtual persons for all items of the three measurement 


2 - 188 PME 2014 


Articles published in the Proceedings are copyrighted by the authors. 


Brand 


points (Rost, 2004). The various dimensions of the modelling competency are 
considered as being the latent variables that can be estimated as a multivariate function 
of the items solved. The scaling was carried out with Conquest (Wu et al., 2007). Ina 
first step, different psychometrical models of the structure of the modelling 
competency were scaled, a one-dimensional model as well as a four-dimensional 
between-item model and two multidimensional within-item models. To select the best 
model for the data, the psychometrical measures Akaike Information Criterion (AIC), 
Bayes Information Criterion (BIC) and Consistent AIC (CAIC) were used (Rost, 
2004). After the model selection, weighted likelihood estimates (WLE) were estimated 
as individual ability parameters and converted to an average value of M=50 and a 
standard deviation of SD=10. To analyse the progress of the modelling competencies 
within the two groups, amongst other evaluations, the average test performances of the 
students were tested for significance that were corrected by the Bonferroni method. In 
addition, the effect sizes of the performance differences were calculated. 


RESULTS 


The comparison of the four 
psychometrical models points to the aiaauie 
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others (Rost, 2004). In addition, the 


reliabilities of the four dimensions are Figure 3: Four-dimensional 
acceptable and vary between 0.767 between-item model 
and 0.821. 


Regarding the development of the four dimensions of modelling competencies the data 
show for all groups of students highly significant increases between the first and the 
second as well as between the first and the third measurement points (see Table 2). In 
the first dimension simplifying / mathematising there 1s a higher effect size in increase 
of the holistic group between the pre- and the post-test (0.88) compared to the atomistic 
group (0.72). Between the pre- and the follow-up-test the atomistic group shows a 
larger effect size (0.68) than the holistic group (0.59). The effect sizes in the dimension 
of working mathematically are larger in the atomistic group between measurement 
point one and measurement point two (0.57 versus 0.47) as well as between 
measurement point one and measurement point three (0.46 compared to 0.32). The 
effect sizes in increase in the dimension of interpreting / validating are higher in the 
holistic group between the pre- and the post-test (0.77 compared to 0.69) as well as 
between the post- and the follow-up-test (0.65 instead of 0.57). In the fourth 
dimension, the overall modelling competency, there are larger effect sizes in increase 
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in the holistic group as well (0.90 versus 0.68 between the first two and 0.61 instead of 
0.35 between the first and the third measurement point. 


Mean MP 1 Mean MP2 Mean MP3 MPI—-MP2 MPI—MP3 = MP2—-MP3 
(SD) (SD) (SD) (Cohen‘sd) (Cohen‘sd)  (Cohen‘s d) 
Simplifying / mathematising 
Holistic 48.26 57.60 54.90 ae oo ali +6.64*** -2.69* 
group (11.29) (9.87) (11.14) (0.88) (0.59) (-0.26) 
Mewiet: SID1 57.62 57.08 +6.41**# +5,.878** -0.54 
group (7.80) (9.84) (9.39) (0.72) (0.68) (-0.06) 
Working mathematically 
Holistic 49.94 54.92 53.10 +495" * ody -1.82* 
group (10.18) (10.83) (9.29) (0.47) (0.32) (-0.18) 
Atomistic 48-85 54.76 53.81 +5.918** — 44.95*** 0.96 
group (9.16) (11.35) (i933) (0.57) (0.46) (-0.08) 
Interpreting / validating 
Holistic 47.93 55.83 54.38 oor +O457"* -1.45 
group (9.42) (11.07) (10.50) (0.77) (0.65) (-0.13) 
Atomistic 50.55 56.73 55.79 +6, 19% +5.24*%% -0.95 
group (8.86) (8.95) (9.59) (0.69) (0.57) (-0.10) 
Overall modelling competency 
Holistic 49.78 58.08 53.55 +8.30*** +100" ee al 
group (9.34) (9.20) (9.62) (0.90) (0.61) (-0.27) 
Rionicie. 5075 57.28 54.21 +6.52*** +3.46* -3.07* 
group (9.74) (9.46) (9.81) (0.68) (0.35) (-0.32) 


*#y<0.000, **p<0.01, *p<0.05 


Table 2: Means and performance increases of the different dimensions of the 
modelling competency 


To receive detailed information about the differences in the performance increase 
between different groups of students, two-way ANOVAs with repeated measures were 
used. The results of the two-way ANOVAs show that there can be seen only significant 
effects of the modelling approach (in favour of the holistic approach) in the dimension 
simplifying / mathematising and the overall modelling competency and only between 
the first two measurement points. Differentiated between the two school types, the 
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two-way ANOVAs reveal that there is no significant effect of the modelling approach 
for the students of the secondary higher-track schools while there were significant 
effects of the modelling approach for all dimensions of the modelling competencies (in 
favour of the holistic approach) for the students of the two comprehensive schools. 


DISCUSSION OF THE RESULTS 


The results of the study are on the one hand related to the structure of modelling 
competencies and on the other hand on the development of the modelling 
competencies of the students. 


The results of the model comparison confirm the possibility to distinguish different 
facets of modelling competencies. The multidimensionality of the construct modelling 
competencies was also shown by Zottl, Ufer, and Reiss (2010), while in their study the 
overall modelling competency was not seen as separated from the sub-processes of 
mathematical modelling as it could be shown in this study. This fact may be explicable 
by various aspects, mainly a different definition of the dimension of overall modelling 
competency including meta-cognitive aspects (see above). 


The evaluation of the modelling tests shows that the effectiveness of the two 
approaches towards fostering students’ modelling competencies has to be considered 
in a differentiated way. On the one hand the data showed that, despite the limitations of 
the reliability of the results particularly in field studies, in the project ERMO both the 
holistic and atomistic approach fostered the development of the different dimensions 
of the students’ modelling competencies under real teaching conditions successfully. 
On the other hand, differences between different groups of students and between the 
four dimensions of modelling competencies became apparent. A general superiority of 
one approach could not be stated. The results indicate that the approach for 
high-performance students plays a minor role, since no effect of the approach was 
found for the dimensions of modelling competencies for students of higher track 
schools (so-called Gymnasien). In contrary, especially for relatively less powerful or 
for heterogeneous classes the holistic approach seems to be superior to the atomistic 
approach, because for the students of the comprehensive schools (the so-called 
Stadtteilschulen) there higher performance increases were found in the holistic group. 
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